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Abstract. We study a spatial branching model, where the underlying motion is d-dimensional (d > 1) Brownian 
motion and the branching rate is affected by a random collection of reproduction suppressing sets dubbed mild 
obstacles. The main result of this paper is the quenched law of large numbers for the population for all d> 1. We 
also show that the branching Brownian motion with mild obstacles spreads less quickly than ordinary branching 
Brownian motion by giving an upper estimate on its speed. When the underlying motion is an arbitrary diffusion 
process, we obtain a dichotomy for the quenched local growth that is independent of the Poissonian intensity. More 
general offspring distributions (beyond the dyadic one considered in the main theorems) as well as mild obstacle 
models for superprocesses are also discussed. 

Resume. Nous etudions un modele de branchement spatial oii le mouvement de base est Brownien d-dimensionnel 
(d > 1) et le taux de branchement est modifie par une collection aleatoire d'ensembles sur lesquels la reproduction 
n'a pas lieu [obstacles moux). Le resultat principal de cet article est I'asymptotique (en probabilite) des taux de 
croissance globaux "quenches" pour tout d> 1, et nous identifions les termes de correction sous-exponentielle. Nous 
montrons aussi que le branchement Brownien avec obstacles moux diffuse moins vito que le branchement Brownien 
classique en donnant une borne superieure de sa vitesse. Dans le cas ou le mouvement de base est un processus 
de diffusion arbitraire nous obtenons une dichotomic pour la croissance locale "quenchee" qui est independante de 
I'intensite Poissonnienne. Le cas de distributions plus generales du nombre de descendants (autre que le cas dyadique 
considere dans les theoreme principaux), ainsi que des modeles d'obstacles moux pour des superprocessus, sont aussi 
discutes. 
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1. Introduction 

1.1. Model 

The purpose of this article is to study a spatial branching model with the property that the branching 
rate is decreased in a certain random region. More specifically we will use a natural model for the random 
environment: mild Poissonian obstacles. 

Let w be a Poisson point process (PPP) on M'' with intensity ly > and let P denote the corresponding 
law. Furthermore, let a > and < /9i < /32 be fixed. We define the branching Brownian motion (BBM) with 
a mild Poissonian obstacle, or the /32, a)-BBM' as follows. Let B{z,r) denote the open ball centered 

at z e M'' with radius r and let K denote the random set given by the a- neighbor hood of oj: 

K = K^:= U B{x„a). 

Xi Esupp(aj) 

Then i^" is a mild obstacle configuration attached to u). This means that given w, we define as the law of 
the strictly dyadic (i.e. precisely two offspring) BBM on W^, d>l, with spatially dependent branching rate 

/3(x,w) :=/3ifKjx)+/32lKc(a;). 

An equivalent (informal) definition is that as long as a particle is in K'^ , it obeys the branching rule with 
rate /32, while in K its reproduction is suppressed and it branches with the smaller rate /3i. (We assume 
that the process starts with a single particle at the origin.) The process under is called a BBM with 
mild Poissonian obstacles and denoted by Z. The total mass process will be denoted by \Z\. Further, W 
will denote d-dimensional Brownian motion with probabilities {P^^, x S W^}. 

As usual, for < 7 < f and for non-empty compact sets /C C K'^ define the set (Holder-space) C'^{JC), as 
the set of continuous bounded functions on JC for which ||/||c^ '■= ||/||oo + \I\c-i is finite, where \f\c-i '■= 
STiPxeK /i/o ^'^^'^"'"[h]-^'^^^''^ • Then = ^{W^) will denote the space of functions on M'' which, restricted on 
/C, are in C^{JC) for all non-empty compact set /C C M''. 

Finally, \_z\ will denote the integer part of z e M: \_z\ := max{n G Z | n < z}. 

The following obvious comparison between an ordinary 'free' BBM and the one with mild obstacles may 
be useful to have in mind. 

Remark 1 (Comparison) . Let P correspond to the 'free' BBM with branching rate P2 everywhere. Then 
for all t>0, all BC R'^ Borel, and all keM, 

P'^{Zt{B) <k)>P{Zt{B) <k) P-a.s., 

that is, the 'free' BBM is 'everywhere stochastically larger' than the BBM with mild obstacles, P-a.s. 

1.2. Motivation 

In this section we list some problems motivating the study of our particular setting. 

(1) Poissonian obstacles. Topics concerning the survival asymptotics for a single Brownian particle among 
Poissonian obstacles became a classic subject in the last twenty years, initiated by Sznitman, Bolthausen and 
others. It was originally motivated by the celebrated 'Wiener-sausage asymptotics' of Donsker and Varadhan 
in 1975 and by mathematical physics, and the available literature today is huge - see the fundamental 
monograph [35] and the references therein; see also e.g. [3, 30, 34] for more recent results. 

(2) Spatial branching processes in a random environment. In [11] a model of a spatial branching process in 
a random environment has been introduced. There, instead of mild obstacles, we introduced hard obstacles 
and instantaneous killing of the branching process once any particle hits the trap configuration K . 

In [12] the model was further studied, and resulted in some unexpected results, and a similar model with 
'individual killing rule' was also suggested. Individual killing rule means that only the individual particle 
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hitting K is eliminated and so the process dies when the last particle has been absorbed. The difference 
between that model and the model we consider in the present article is that now the killing mechanism 
is even 'milder' as it only suppresses temporarily the reproduction of the individual particle but does not 
eliminate the particle. 

(3) Law of large numbers. It is a notoriously hard problem to prove the law of large numbers (that is, 
that the process behaves asymptotically as its expectation) for spatial branching systems - see e.g. [18] for a 
special case. In our situation the scaling is not purely exponential. In general, the not precisely exponential 
case is difficult^ and it is interesting that in our setup randomization will help in proving a kind of LLN - 
see more in Section 3.1. 

(4) Wavefronts in random medium. The spatial spread of our process is related to a work of Lee-Torcaso 
[31] on wave-front propagation for a random KPP equation and to earlier work of Freidlin [24] on the KPP 
equation with random coefhcients - see Section 3.2 of this paper, and also [36] for a survey. 

(5) Catalytic spatial branching. An alternative view on our setting is as follows. Arguably, the model 
can be viewed as a catalytic BBM as well - the catalytic set is then K'^ (in the sense that branching is 
'intensified' there). Catalytic spatial branching (mostly for superprocesses though) has been the subject of 
vigorous research in the last twenty years initiated by Dawson, Fleischmann and others - see the survey 
papers [28] and [8] and references therein. In those models the individual branching rates of particles moving 
in space depend on the amount of contact between the particle ('reactant') and a certain random medium 
called the catalyst. The random medium is usually assumed to be a 'thin' random set (that could even 
be just one point) or another superprocess. Sometimes 'mutually' or even 'cyclically' catalytic branching is 
considered [8]. 

Our model is simpler than most catalytic models as our catalytic/blocking areas are fixed, whereas in 
several catalytic models they are moving. On the other hand, while for catalytic settings studied so far 
results were mostly only qualitative we are aiming to get a quite sharp quantitative result. 

For the discrete setting there are much fewer results available. One example^ is [26], where the branching 
particle system on Z'^ is so that its branching is catalyzed by another autonomous particle system on 'E'^. 
There are two types of particles, the yl-particles ('catalyst') and the B-particles ('reactant'). They move, 
branch and interact in the following way. Let Na{x,s) and Nb{x,s) denote the number of A- [resp. B- 
]particles at a; S Z'' and at time s G [0,cx)). (All Na{x,0) and Nb{x,0), x G Z'^ are independent Poisson 
variables with mean fi^ {^b)-) 

Every A-particle (i?-particle) performs independently a continuous-time random walk with jump rate Da 
(Db). In addition a _B-particle dies at rate 6, and, when present at x at time s, it splits into two in the next 
ds time with probability (}NA{x,s)ds + o(ds). Conditionally on the system of the A-particles, the jumps, 
deaths and splitting of the i3-particles are independent. For large f3 the existence of a critical i5 is shown 
separating local extinction regime from local survival regime. 

Remark 2 (Self -duality). The discrete setting has the advantage that when R'' is replaced by ifi , the 
difference between the sets K and K'^ is no longer relevant. Indeed, the equivalent of a Poisson trap config- 
uration is an i.i.d. trap configuration on the lattice, and then its complement is also i.i.d. (with a different 
parameter). So, in the discrete case 'Poissonian mild obstacles' give the same type of model as 'Poissonian 
catalysts ' would. This nice duality is lost in the continuous setting as the 'Swiss cheese ' K'^ is not the same 
type of geometric object as K. 

(6) Population models. It appears that our proposed model of a BBM with 'mild' obstacles has biological 
merit to it (see Appendix B for more elaboration). 

Returning to our mathematical model, consider the following natural questions (both in the annealed and 
the quenched sense): 

(1) What can we say about the growth of the total population size? 



-"^See for example the recent preprints [21] and [23]. 
further example of the discrete setting is [2]. 
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(2) What arc the large deviations? (e.g.. what is the probabihty of producing an atypically small popula- 
tion?) 

(3) What can we say about the local population growth? 

As far as (1) is concerned, recall that the total population of an ordinary (free) BBM grows a.s. and in 
expectation as e^^*. (Indeed, for ordinary BBM, the spatial component plays no role, and hence the total 
mass is just a /?2-rate pure birth process X. As is well known, the limit N := limt^oo e~^^*Xt exists a.s. and 
in mean, and P(0 < N < oo) = 1.) In our model of BBM with the reproduction blocking mechanism, how 
much will the suppressed branching in K slow the global reproduction down? Will it actually change the 
exponent /32? (Wc will see that although the global reproduction does slow down, the slowdown is captured 
by a sub-exponential factor, being different for the quenched and the annealed case.) 

Consider now (2). Here is an argument to give a further motivation. Let us assume for simplicity that 
/3i = and ask the simplest question: what is the probability that there is no branching at all up to time 
t > 0? In order to avoid branching the first particle has to 'resist' the branching rate /32 inside K'^. Therefore 
this question is quite similar to the survival asymptotics for a single Brownian motion among 'soft obstacles' 

- but of course in order to prevent branching the particle seeks for large islands covered by K rather than 
the usual 'clearings.' In other words, the particle now prefers to avoid K'^ instead of K. Hence, (2) above is 
a possible generalization of this (modified) soft obstacle problem for a single particle, and the presence of 
branching creates new types of challenges. 

As far as (3) is concerned, it will be shown to be related to the recent paper [15] which treats branching 
diffusions on Euclidean domains. 

An additional problem, regarding the spatial spread of the process, will be investigated using the result 
obtained on the (quenched) growth of the total population size. 

1.3. Outline 

The rest of this article is organized as follows. The next section gives an overview on some facts that are 
easy to derive from results in the literature. Section 3 presents the results. Theorems 1 and 2. Section 4 
presents some further problems, while Section 5 contains some preparations and also gives the short proofs 
of the preliminary claims. In Section 6 the first main theorem is proven. Section 7 presents some additional 
problems - these problems are presented separately because they refer to certain parts of the proof. In 
Section 8 we prove Theorem 2. In the first appendix we explain how our mathematical setting relates to 
models in biology. Finally the second appendix presents a proof of a statement which is needed in the proofs 

— we think the statement is of independent interest. 

2. Some preliminary claims 

In this section we state some results that are straightforward to derive from other results in the literature. 
The proofs are provided in Section 5. 

2.1. Expected global growth and dichotomy for local growth 

Concerning the expected global growth rate we have the following result. 

Claim 3 (Expected global growth rate). On a set of full P -measure, 

as t ^ CO (1) 

(guenched asymptotics) and 



£;"|Zt|==exp 



f}2t — c{d, u) 



(l0gi)2/d 



(1 + 0(1)) 



{^®E'^)\Zt\=eMP2t~c{d,v)t'^''^'^+^\l + Q{l))] ast^oo 



(2) 
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(annealed asymptoties), where 
c{d,iy) ■.= Xd[ 

and LUd is the volume of the d-dimensional unit ball, while Xd is the principal Dirichlet eigenvalue of —^A 
on it. 

Notice that: 

(1) /3i does not appear in the formulas, 

(2) the higher the dimension, the smaller the expected population size. 

Remark 4 (The difference between the quenched and the annealed asymptoties; dimension). 

Let us pretend for a moment that we are talking about an ordinary BBM. Then at time t one has c*^^^* 
particles with probability tending to one as t ^ oo (the population size divided by e''^* has a limit, to be 
precise). For t fixed take a ball B — -6(0, R) (here R — R(t) ) and let K be so that B C K"^ (such a ball left 
empty by K is called a clearing/ Consider the expected number of particles that are confined to B up to 
time t. These particles do not feel the blocking effect of K , while the other particles may have not been bom 
due to it. 

Optimize R{t) with respect to the cost of having such a clearing and the probability of confining a single 
Brownian motion to it. This is precisely the same optimization as for the classical Wiener- sausage. Hence 
one gets the expectation in the theorem as a lower estimate. 

One suspects that the main contribution in the expectation in (2) is coming from the expectation on the 
event of having a clearing with optimal radius R{t) . In other words, denoting by pt the probability that a 
single Brownian particle stays in the R{t)-ball up to time t, one argues heuristically that ptS^^^ particles will 
stay inside the clearing up to time t 'for free' (i.e. with probability tending to one ast—foo). 

The intuitive reasoning is as follows. If we had independent particles instead of BBM, then, by a 'Law 
of Large Numbers type argument' (using Chebyshev inequality and the fact that hmt^ooPt^^^ =oo), roughly 
PtS^^^ particles out of the total e'"^* would stay in the R{t)-ball up to time t with probability tending to 1 
as t1 oo. One suspects then that the lower estimate remains valid for the branching system too, because the 
particles are 'not too much correlated.' This kind of argument (in the quenched case though) will be made 
precise in the proof of our main theorem by estimating certain covariances. 

To understand the difference between the annealed and the quenched case note that in the latter case large 
clearings (far away) are automatically (that is, F-a.s.) present. Hence, similarly to the single Brownian 
particle problem, the difference between the two asymptoties is due to the fact that even though there is 
an appropriate clearing far away P-a.s., there is one around the origin with a small (but not too small) 
probability. Still, the two cases will have a similar element when, in Theorem 1 we drop the expectations and 
investigate the process itself, and show that inside such a clearing a large population is going to flourish (see 
the proof of Theorem 1 for more on this). This also leads to the intuitive explanation for the decrease of the 
population size as the dimension increases. The radial drift in dimension d is [d— l)/2. The more transient 
the motion (i.e., the larger d), the harder it is for particles to stay in the appropriate clearings. 

Concerning local population size we present the following (quenched) claim. 

Claim 5 (Quenched exponential growth). The following holds on a set of full V-measure: For any 
e > and any bounded open set % ^ B d , 

P;:'(limsupe"(''"~'')*Zt(S) = oo) > and P;;' (limsupe-'3^*Zt(P) < cx)) = 1. 
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Problem 6. What can one say about the distribution of the global and the local population size? The 
quenched asymptotics of the expected logarithmic global growth rate suggests that perhaps the rate itself 
is around (32 — c(o?, i^)(log<)~^/'^ at time t in some sense. This problem will be addressed in Section 3.1. We 
will prove an appropriate formulation of the statement when the limit is meant in probability. 

We now show how Claim 5 can be generalized for the case when the underlying motion is a diffusion. 
Let P be as before but replace the Brownian motion by an i-diffusion X on R'', where i is a second-order 
elliptic operator of the form 

" ^2 " g 

2J — 1 i — 1 

with flij", bi S C , 7 e [0, 1); and the symmetric matrix aij{x) is positive definite for all x E M''. The branching 
i-diffusion with the Poissonian obstacles can be defined analogously to the case of BM. To present the result, 
we need an additional concept. Let 

Xc{L) = Xc{L,R'^) := inf{A G M: 3u>0 satisfying (L - \)u = in R'^} 

denote the generalized principal eigenvalue for L on R*^. In fact Ac < 0, because LI = - see Section 4.4 in 
[32]. 

The following claim shows that the local behavior of the process exhibits a dichotomy. The crossover is 
given in terms of the local branching rate P2 and the term Xc{L): local extinction occurs when the branching 
rate inside the 'free region' K'^ is not sufficiently large to compensate the transience of the underlying L- 
diffusion; if it is strong enough, then local mass grows exponentially. Note an interesting feature of the result: 

neither Pi nor the intensity v of the obstacles play a role. 

Claim 7 (Quenched exponential growth/local extinction). Given the environment uj , denote by 
the law of the branching L- diffusion. 

(i) Let P2 > — Ac(L) and let v > Q and Pi € (0,P2) be arbitrary. Then the following holds on a set of full 
F -measure: For any e > and any bounded open set % ^ B G , 

P'^ flimsupe(-'^=~^'=(^)+")*Zt(B) = 00) > 

^ (Too ' 

and 

P"'(limsupe(-^=-^'=(^»*Zt(P) <oo) =1. 

(ii) Let P2 < —Xc{L) and let v > Q and Pi G (0,/32) be arbitrary. Then the following holds on a set of full 

-measure: For any bounded open set B C M.'^ there exists a -a.s. finite random time to = to{B) such 
that Xt{B) — for all t>to (local extinction). 

3. Results 

3.1. Quenched asymptotics of global growth; LLN 

In this section we investigate the behavior of the (quenched) global growth rate. 

As already mentioned in the Introduction of this paper, it is a notoriously hard problem to prove the 
law of large numbers for spatial branching systems, and, in general, the not purely exponential case is very 
challenging. 

To elucidate this point, let us consider a branching diffusion with motion component corresponding to 
a second order elliptic operator L on some Euclidean domain D C M'' and with spatially dependent (not 
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identically zero) branching rate /3 > 0. Let ^ / be a nonnegative compactly supported bounded measurable 
function on D. If Ac, the generalized principal eigenvalue of L + /3 on D is positive and S = {St\t>o denotes 
the semigroup corresponding to L + /3 on Z?, then {Stf){-) grows (pointwise) as e'^'=* on an exponential scale. 
However, in general, the scaling is not precisely exponential due to the presence of a subexponential term. 

Instead of discussing here the appropriate spectral conditions for having precisely exponential scaling we 
refer the reader to Appendix A of [19] and note that in the present case it turns out that the resulting 
operator + (3 does not scale precisely exponentially P-a.s. Replacing / by the function g = 1, it is still 
true that the growth is not precisely exponential - this is readily seen in Claim 3 and its proof. 

Since the process in expectation is related to the semigroup S, therefore purely exponential scaling 
indicates the same type of scaling for the expectation of the process (locally or globally) . It turns out that 
if one is interested in the scaling of the process itself (not just the expectation), the case when there is an 
additional subexponential factor is much harder (see e.g. [19] and references therein). 

In the proof of Theorem 1 below it is the randomization of the branching rate /3 that helps, as (3 has some 
'nice' properties for almost every environment lu, i.e. the 'irregular' branching rates 'sit in the P-zero set.' 

Define the average growth rate by 

\og\Ztiu;)\ 
Tt = rt(uj) := . 

Replace now ]Zt(a;)] by its expectation Zt := E'^\Zt{uj)\ and define 

- ^, . logZt 
rt = rt(uj) := — - — . 

Recall from Claim 1, that on a set of full P-measure, 

hm {\ogtf'\?t - /32) = -c{d,v). (3) 

t — >oo 



We are going to show that an analogous statement holds for rt itself. 



Theorem 1 (LLN). On a set of full V -measure, 

lim {\ogtf/'^{rt - (32) = ~c{d, v) in P"^ -probability. (4) 



One interprets Theorem 1 as a kind of quenched law of large numbers. Loosely speaking, 

r-t « /32-c(d,i^) (log t)-2/rf« ft, t^oo. 



on a set of full P-measure. 



3.2. The spatial spread of the process 



3.2.1. Introduction 

L. Mytnik asked how much the speed [spatial spread) of free BBM reduces due to the presence of the mild 
obstacle configuration. Note that we are not talking about the bulk of the population (or the 'shape') but 
rather about individual particles traveling to very large distances from the origin (cf. Section 7). 

As is well known, ordinary 'free' branching Brownian motion with constant branching rate /32 > has 
radial speed ^/2(32 (see the recent paper [29] for a review and a strong version of this statement). Let Nt 
denote the population size at t > and let < k < Nt) denote the position of the fcth particle (with 

arbitrary labeling) in the population. Furthermore, let m(t) denote a number for which u{t,m{t)) = i, where 



u{t, x) 



max \\£k(t)\\ 



< X 
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In his classic paper, Bramson [5] considered the one-dimensional case and proved that as t — > oo, 

mit)^t^2-,r^logt + 0{l). (5) 

Since the one-dimensional projection of a d-dimensional branching Brownian motion is a one-dimensional 
branching Brownian motion, we can utilize Bramson's result for the higher dimensional cases too. Namely, it 
is clear, that in high dimension the spread is at least as quick as in (5). In [5] the asymptotics (5) is derived 
for the case /?2 = 1; the general result can be obtained similarly. See also p. 438 in [24]. (It is also interesting 
to take a look at [4].) Studying the function u has significance in analysis too as u solves 

9m 1 , 2 \ 

-g^ = -^Ur,^ + P2(U ~U), (6) 

with initial condition 



w(0,-) = l[o,oo)(-)- (7) 

In this section we show that the branching Brownian motion with mild obstacles spreads less quickly than 
ordinary branching Brownian motion by giving an upper estimate on its speed. 

A related result was obtained earlier by Lee and Torcaso [31], but, unlike in (5), only up to the linear 
term and moreover, for random walks instead of Brownian motions. The approach in [31] is to consider the 
problem as the description of wavefront propagation for a random KPP equation. They extended a result 
of Freidlin and Gartner for KPP wave fronts to the case d > 2 for i.i.d. random media. In [31] the wavefront 
propagation speed is attained for the discrete-space (lattice) KPP using a large deviation approach. Note 
that the 'speed' is only defined in a logarithmic sense. More precisely, let u denote the solution of the discrete- 
space KPP equation with an initial condition that vanishes everywhere except the origin. The authors define 
a bivariate function on K. x K.'' \ {0} and show that it satisfies 

lim - \ogu{t,tve) = ~[F{v,e)y Q], 

t — >OD t 

for all w > and e € R'^ \ {0}. It turns out that there is a unique solution v ~ Ve to F{v,e) ~ 0, and 
defines the 'wave speed.' In particular, the speed is non-random. 

Unfortunately, it does not seem to be easy to evaluate the variational formula for given in [31], even 
in very simple cases. 

It should be pointed out that the problem is greatly simplified for d = 1 and it had already been inves- 
tigated by Freidlin in his classic text [24] (the KPP equation with random coefficients is treated in Section 
VII. 7. 7.). Again, it does not seem clear whether one can easily extract an explicit result for the speed of 
a branching RW with i.i.d. branching coefficients which can only take two values, < /3i < /32 (bistable 
nonlinear term). 

The description of wavefronts in random medium for c? > 1 is still an open and very interesting problem. 
The above work of Torcaso and Lee concerning processes on Z'' is the only relevant article we are aware of. 
To the best of our knowledge, the problem is open; it is of special interest for a bistable nonlinear term. 

Before turning to the upper estimate, we discuss the lower estimate. 



3.2.2. On the lower estimate on the radial speed 

We are going to show that, if in our model Brownian motion is replaced by Brownian motion with con- 
stant drift 7 in a given direction, then any fixed non-empty ball is recharged infinitely often with positive 
probability, as long as the drift satisfies I7I < y/2j32- 

For simplicity, assume that d=l (the general case is similar). Fix the environment lo. Recall Doob's 
/i-transform of second-order elliptic operators: 



L'\-):^-L{h-). 
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Applying an /i-transform with h(x) :=cxp(— 7x), a straightforward computation shows that the operator 

r 1 d2 d ^ 

^^=2d^+^d^ + ^^ 
transforms into 

^ "2d^~Y+^^- 

Then, similarly to the proof of Claim 7, one can show that the generalized principal eigenvalue for this latter 

2 

operator is — +/32 for almost every environment. Since the generalized principal eigenvalue is invariant 

2 

under ^.-transforms, it follows that — ^ + /32 > is the generalized principal eigenvalue of L. Hence, by 
Lemma 10, any fixed non-empty interval is recharged infinitely often with positive probability. 

Turning back to our original setting, the application of the 'spme '-technology seems also promising. 

Roughly speaking, the spine method uses a Girsanov-type change of measure on the branching diffusion. 
On one hand, the Girsanov density is a known (mean-one) martingale, for which the question of uniform 
integrability can be checked. On the other hand, under the new measure, the process can be represented 
'directly' by a 'spine' or 'backbone' type construction. The 'spine' represents a special ^deviant' particle 
performing a motion which has important properties from the point of view of the problem regarding the 
original branching process. The question regarding 'going back to the original measure' is then related to 
the UI property of the martingale. (See [25, 29] and references therein.) 

In our case it is probably not very difficult to show the existence of a 'spine' particle (under a martingale- 
change of measure) that has drift 7 as long as I7I < -\/2^. 



3.2.3. An upper estimate on the radial 
Our main result in this section is an upper estimate on the speed of the process. We give an upper estimate 
in which the order of the correction term is larger than the 0(logt) term appearing in Bramson's result, 
namely it is 0( (i^glj2/d )- (AH orders are meant for t ^ 00.) We show that, loosely speaking, at time t the 
spread of the process is not more than 



2 [logtyi'^' 

(Again, Pi plays no role as long as (ii G (0,/32).) The precise statement is as follows. 
Theorem 2. Define the functions 



where we recall that c{d^v) :~ Ad(-^^)^^'* and ujd is the volume of the d-dimensional unit ball, while Xd is 
the principal Dirichlet eigenvalue of — ^A on it. Then 

nit) . tVW. - cid, .)/f . + O (^^) . (8) 

Furthermore, if 

At :~ {no particle has left the n(t) - ball up to i\ 
U supp(Z3)CB(0,n(t)) 

0<s<i 



Branching Brownian motion in a random medium 



499 



then on a set of full P -measure, 



liminfP"(At) >0. 



(9) 



4. Further problems 

In this section we suggest some further problems and directions for research. 
4-1. More general branching 

It should also be investigated, what happens when the dyadic branching law is replaced by a general one 
(but the random branching rate is as before). In a more sophisticated population model, particles can also 
die - then the obstacles do not necessarily reduce the population size as they sometimes prevent death. 

J^.1.1. Supercritical branching 

When the offspring distribution is supercritical, the method of our paper seems to work, although when the 
offspring number can also be zero, one has to condition on survival for getting the asymptotic behavior. 

4- 1-2. (Sub)critical branching 

Critical branching requires an approach very different from the supercritical one, since taking expectations 
now does not provide a clue: E'^\Zt{^JJ)\ = 1, Vt > 0, VtJ e Q. 

Having the obstacles, the first question is whether it is still true that 

(extinction) = 1 Mlj^Q. 

The answer is yes. To see this, note that since \Z\ is still a martingale, it has a nonnegative a.s. limit. This 
limit must be zero; otherwise \Z\ would stabilize at a positive integer. This, however, is impossible because 
following one Brownian particle it is obvious that this particle experiences branching events for arbitrarily 
large times. 

Setting /3i = 0, the previous argument still goes through. Let r denote the almost surely finite extinction 
time for this case. One of the basic questions is the decay rate for P"(r > t). Will the tail be significantly 
heavier than 0(1/^;)? (Of course \/t would be the rate without obstacles.) 

The subcritical case can be treated in a similar fashion. In particular, the total mass is a supermartingale 
and P'^ (extinction) = 1 Vw € 

4.2. Superprocesses with mild obstacles 

A further goal is to generalize the setting by defining superprocesses with mild obstacles analogously to the 
BBM with mild obstacles. Recall the concept of an (i, /?, a)-superdiffusion: Let A^f denote the set of finite 
measures ^ on and let a,/3 denote functions in the Holder space satisfying a > and sup^-gRd P{x) < 
00. 

Notation 8. Let (X, P^, /i G Alf) denote the (L, f3,a)-superdi]Jusion. That is, X is the unique Mi-valued 
(time-homogeneous) continuous Markov process which satisfies, for any bounded continuous g : K.'' i-^ M_|_ , 




(10) 



where u is the minimal nonnegative solution to 




(11) 



500 



J. Engldnder 



One usually refers to L as migration, /3 as mass creation and a as the intensity parameter (or variance). 

In fact, X also arises as the short life time and high density diffusion limit of a branching particle system, 
which can be described as follows: in the nth approximation step each particle has mass 1/n and lives a 
random time which is exponential with mean 1/n. While a particle is alive, its motion is described by a 
diffusion process corresponding to the operator L. At the end of its life, the particle dies and is replaced by 
a random number of particles situated at the parent particle's final position. The distribution of the number 
of descendants is spatially varying such that the mean number of descendants is 1 + , while the variance 
is assumed to be 2a{x). All these mechanisms are independent of each other. 

The definition of the superprocess with mild obstacles is straightforward: the parameter a on the (random) 
set K is smaller than elsewhere. 

Similarly, one can consider the case when instead of a, the 'mass creation term' P is random, for example 
with (3 defined in the same way (or with a mollified version) as for the discrete branching particle system. 
Denote now by P'^ the law of this latter superprocess for a given environment. We suspect that the super- 
process with mild obstacles behaves similarly to the discrete branching process with mild obstacles when 
Xc{L + f3) > and P"(-) is replaced by P'^{-\X survives). The upper estimate can be carried out in a manner 
similar to the discrete particle system, as the expectation formula is still in force for superprocesses. 

As we have already pointed out, there is a large amount of ongoing research on catalytic superprocesses; a 
is usually taken as a thin (sometimes randomly moving) set, or even another superprocess. In those models, 
one usually cannot derive sharp quantitative results. In a very simple one-dimensional model, introduced 
in [13], (3 was spatially varying but deterministic and non-moving - in fact it was the Dirac delta at zero. 
Nevertheless, already in this simple model it was quite challenging to prove the asymptotic behavior of the 
process (Theorem 2 in [18]). Fleischmann, Mueller and Vogt suggest, as an open problem, the description 
of the asymptotic behavior of the process in the three-dimensional case [23]; the two-dimensional case is 
even harder, as getting the asymptotics of the expectation is already difficult. As we have mentioned, the 
randomization of P may help in the sense that /3 has some 'nice' properties for almost every environment lo. 



5. Preparations 

In this section we present some preparatory lemmas and also the proofs of the preliminary claims. 
Lemma 9 (Expectation given by Brownian functional). Fixui. Then 



=Eexp 



ds. 



(12) 



Proof. It is well known ('first moment formula' of spatial branching processes'^; see, for instance (1.50a) in 
[10]), that E^\Zt\ = {Ttl){x), where u{x,t) := (Ttl)(x) is the minimal solution of the parabolic problem: 



du 
'dt 

w(-,0) = l 

u>0. 



(^^A + I3^u on M'' X (0,oo), 



(13) 



(Here {Tt}t>o denotes of course the semigroup corresponding to the generator + p on W'-.) This is 
equivalent (by the Feynman-Kac formula) to (12). □ 

We will also need the following result: Let D QW^ be a (non-empty) domain and let < V, ^ F be 
bounded from above and in [D), 7 e (0, 1]. The (binary) (L, V) -branching diffusion (or more precisely, the 



The statements and their derivations are the same for branching processes and superprocesses. 
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(i, V; _D)-branching diffusion) is the Marfcov process with motion component Y and with spatially dependent 
branching rate V , replacing particles by precisely two offspring when branching. At each time t > 0, the 
process consists of a point process Xt defined on Borel sets of D. 

Lemma 10 ([15], Theorem 3). Given D. let P denote the law of the {L,V) -branching diffusion X and 
let Xc-.^XciL + V). 

(i) Under P the process X exhibits local extinction if and only if Xc <0. 

(ii) When Xc> 0, for any A < Ac and any open ^ ^ B dd D , one has'^ 

P^(limsupe~^*Xt(B) =cx)) >0 and (limsupe"^=*Xt(S) < cx)) = 1. 

^ tToo ^ ^ (Too ^ 

5.1. Proof of Lemma 9 

Since /3 :— (3i1k + Pi'^K" ~ P2 — {P2 — f3i)lK^ we can rewrite the equation (f2) as 
£;'^|Zt| =e'^=*Eexp 

The expectation on the right-hand side is precisely the survival probability among soft obstacles of 'height' 
/92 — except that we do not sum the shape functions on the overlapping balls. However this does not 
make any difference with regard to the asymptotics (see [35], Remark 4.2.2.). The statements thus follow 
from the well known Donsker-Varadhan type 'Wiener asymptotics' for soft obstacles (see [35], Theorems 
4.5.1. and 4.5.3.; see also [9]). 

5.2. Proof of Claim 5 

Since in this case L = A/2 and since Ac(Z\/2,IR'') = 0, the statement immediately follows from Claim 7. 

5.3. Proof of Claim 7 

In order to be able to use Lemma 10, we compare the rate (3 with another, smooth (i.e. C^) function V. 
Recalling that K = := Uiiesupp(w) B{xi,a), let us enlarge the obstacles: 

K*=KZ:= y B{x,M- 

Then {K*Y c isT^ Recall that (5{x) := I3iIk{x) + /321k- (a;) < /32 and let F e (7 £ (0, 1]) with 

p2liK'Y<V<f3. (14) 

(The existence of a continuous function satisfying (14) would of course immediately follow from Uryson's 
lemma (Lemma 4.4 in [27]). In fact it is easy to see the existence of such functions which are even C°° 
by writing P = P2 — {P2 — 0i)Ik and considering the function V :— (32 — {P2 — /3i)/, where / > 1k' and 
/ is a C°°-function obtained as follows. / is a sum of compactly supported C°°-functions /„, n > 1, with 
disjoint support, where supp(/„) is in the e„-neighborhood of the nth connected component of Ik*, with 
appropriately small < e„'s.) Consider the operator L + V anW'' and let Ac = Ac(a;) denote its generalized 
principal eigenvalue. Since V € C*", we are in the setting of Chapter 4 in [32] and Lemma 10. In particular, 
since V < (32, one has Ac < Xc{L) + (32 for every lo (see Theorem 4.4.4 in [32]). 

On the other hand, one gets a lower estimate on Ac as follows. Fix i? > 0. Since (32^[k*y — 
homogeneity of the Poisson point process, for almost every environment the set {a: G M** | V{x) = (32} contains 



^B CG D means that B is bounded and its closure B satisfies B C D. 



-I {(32-(3i)Ik{W,)As . 
. Jo 
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a clearing of radius R. Hence, by comparison. Ac > A'-^'^'-' , where A*-^-* is the principal Dirichlet eigenvalue of 
L + P2 on a ball of radius R. Since R can be chosen arbitrarily large and since Wuirioo A^^^ = Ac(L) + P2, 
we conclude that Ac > Xc{L) + (32 for almost every environment. 
From the lower and upper estimates, we obtain that 

Ac = Xc{L) + (32 for a.e. oj. (15) 

Consider now the branching processes with the same motion component L but with rate V, respectively 
constant rate (32- The statements (i) and (ii) of Claim 7 are true for these two processes by (15) and Lemma 
10. As far as the original process (with rate (3) is concerned, (i) and (ii) of Claim 7 now follow by tj-wise 
comparison. 

6. Proof of Theorem 1 

We give an upper and a lower estimate separately. 

6.1. Upper estimate 

Let e > 0. Using the Markov inequality along with the expectation formula (1). we have that on a set of full 
P-measure: 

P"[(log<)'/''(rt-/?2) + c(d,i^)>e] 

= P-{\Zt\> exp[t(/32 - c(d,j.)(logt)-2/'^ + e{logt)-^/')]} 
<i?"|Z,|.(exp[t(/32-c(d,z.)(logi)-2/'^ + e(logi)-2/'i)])-i 
= exp[~et{logt)-^/'^ + o{t{\ogt)-^/'^)] ^0 as i ^ 00. 

6.2. Lower estimate 

We give a 'bootstrap argument': we first prove a weaker estimate which we will later use to prove the stronger 
result. For better readability, we broke the relatively long proof into three parts. 

6.2.1. Part I: A rough exponential lower estimate 
Let Q<5 < (32. Then on a set of full P-measure 

lim P'^dZtl >e''*) = l- (16) 

t — >-oo 

To prove (16), wc invoke the definition of the function V from Section 5.3: V (7 G (0, 1]) with 

(32liK'r<V<p. (17) 

(Recall that (3{x) := (}i1k{x) + (321k''{x).) By comparison, it is enough to prove (16) for the 'smooth version' 
of the process, where /? is replaced by V. The law of this modified process will be denoted by (and the 
notation Z is unchanged). 

Considering the operator L + V onM.'^ we have seen in Section 7 that its generalized principal eigenvalue 
is Ac(Z\; M'^) +P2=(32 for every lu. 

Take R> large enough so that Ac = Xc{^A + V; B{0, R)), the principal eigenvalue of + on -6(0, R) 
satisfies 



Ac > S. 
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Let Z'^ be the process obtained from Z by introducing killing at dB{0,R) (the corresponding law will be 
denoted by Pi^^). Then 

lim P^i\Zt\< e*'* ) < hm P^^^ ( | Zf \<e^*). (18) 

t — >oo t — >oo 

Let < (p = (p^ be the Dirichlet eigenfunction corresponding to Ac on B{0,R), and normalize it by 
sup^gg(Q jj.-) (f){x) — 1. Then we can continue inequality (18) with 



St\ 



IS 



< lim p(^)((Zf» <e 

t — *oo 

where {Z^, cp) := '/'(^f and {i'f is the 'ith particle' in Z^. Notice that Mt = uf := q-^-^Z^', 
a nonnegative martingale (see p. 84 in [15]), and define 

TV := lim Mt. 

t — 'OO 

Since Ac(P(0, R))>5, and thus Hmj^oo P^^^ {Mt < c^^'^"''* n{N> 0}) = 0, the estimate is then continued 
as 

= lim P''^\Mt<e^^^^^'^*\N = 0)P'^^\N = 0)<P'^^\N^O). 

t — *oo 

We have that 

lim P^{\Zt\ < e*'*) < P(^)(^ = 0) 

t — ^oo 

holds for all R large enough. Therefore, in order to prove (16), it is sufficient to show that 

lim p(-"'(iV>0) = l. (19) 

R — ^oo 

Consider now the elliptic boundary value problem (which of course depends on K), 

^Au + V{u~u^) = mB{0,R), 

lim u(x) = 0, (20) 

x--*dB{0,R} 

u>0 in 5(0, P). 

The existence of a solution follows from the fact that Ac > by an analytical argument given in [33] pp. 262 
and 263. (The proof of the existence of such a u relies on finding so-called lower and upper solutions. The 
assumption Ac > enters the stage when a positive lower solution is constructed.) Uniqueness follows by the 
semilinear maximum principle (Proposition 7.1 in [16]). 

The argument below gives a probabilistic construction for the solution. Namely, we show that wr{x) := 
Px^\n > 0) solves (20). To see this, let v ~ vn :~ I — wn. Let us fix an arbitrary time t>0. Using the 
Markov and branching properties of Z at time t, it is straightforward to show that 



P^"\n = 0\J^t) ='[[P^fliN = 0). 

i 

Since the left hand-side of this equation defines a P^^^ -martingale in so does the right-hand side. That is 



Mt:=Y[viZ, 
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defines a martingale. From tliis, it follows by Theorem 17 of [14] that v solves the equation obtained from 
the first equation of (20) by switching u~ v?' to v? — u. Consequently, wr(x) := Px^^ {N > 0) solves the first 
equation of (20) itself. That wr solves the second equation, follows easily from the continuity of Brownian 
motion. Finally its positivity (the third equation of (20)) follows again from the fact that Ac > (see Lemma 
6 in [15]). 

By the semilinear elliptic maximum principle (Proposition 7.1 in [16]; see also [33]), wr{-) is monotone 
increasing in R. Using standard arguments, one can show that < w := limfl^oo wn too solves the equation 
in array (20) (see the proof of Theorem 1 in [33]). 

Applying the strong maximum principle to v := 1 — it follows that w is either one everywhere or less 
than one everywhere. We now suppose that < w < 1 and will get a contradiction. 

When d<2, this is simple. We have 

{Aw is nonnegative and not identically zero) and this contradicts the recurrence of the Brownian motion 
in one and two dimensions, because it is known that if L corresponds to a recurrent diffusion then there is 
no positive function w satisfying Lw ^ (see Theorem 4.3.9 in [32]). This contradiction proves that in fact 
w = 1 and consequently it proves (16). 
Consider now the problem 

-Au + V{u-u'^) = inR'^, 

(21) 

0<M< 1. 

The nonexistence of solutions in the general d > 1 case is more subtle than for d < 2. It follows from the fact 
that (3 is bounded from below by (3i along with Theorem 1.1 and Remark 2.4 in [17] (set g = (3i in Remark 
2.4 in [17]). 

We have now shown (16) and completed the first part of our 'bootstrap' proof. 



6.2.2. Part II: Scaling for the refined lower estimate 

Let us return to the proof of the lower estimate in Theorem 1. Let e > 0. We have to show that on a set of 
full P-measure, 

lim P'^[(logt)^^^{rt-P2)+c{d,i^)<-e] = 0. (22) 

t — >oo 

To achieve this, we will define a particular function pt (the definition is given in (31)) satisfying that as 

t — > CO, 

Using this function we are going to show a statement implying (22), namely, that for all e > there is a set 
of full P-measure, where 

lim P'^[log|Zt| < (32t + \ogpt - et(logi)-2/''] = o. (24) 

t—^oo 

Let us first give an outline of the strategy of our proof. A key step will be introducing three different time 
scales, £{t), m{t) and t where £{t) — o{m{t)) and m{t) — o{t) a.s oo. For the first, shortest time interval, 
we will use that there are 'many' particles produced and they are not moving 'too far away,' for the second 
(of length m{t) — ((t)) we will use that one particle moves into a clearing of a certain size at a certain 
distance, and in the third one (of length t — m{t)) we will use that there is a branching tree emanating 
from that particle so that a certain proportion of particles of that tree stay in the clearing with probability 
tending to one. 



(23) 
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To carry out this program, first recall the following fact (for example sec Lemma 4.5.2 in the proof of 
Theorem 4.5.1 in [35]): Let 



Ro = Roid,iy) 



A 



l/d 



(recall that is the principal Dirichlct eigenvalue of —\A on the d-dimensional unit ball, and ujd is the 
volume of that ball) and let 

p(0:-i?o(logO'/''-(loglogO', ^>1. (25) 
Then, 

P(3/o(t^) > such that V? > 3 clearing B{xo,p{l)) with |xo| < = 1- (26) 
Next, let £ and m be two functions M+ M+ satisfying the following: 

(i) limt^oo^(i) = oo, 

(ii) limt_,oo isff^ = 1, 

(iii) i{t) ~ o{m{t)) as < ^ oo, 

(iv) m{t) = o{e^{t)) as t ^ oo, 

(v) m{t) = o(t(logt)-2/d) as i ^ oo. 

Note that (i)-(v) are in fact not independent, because (iv) follows from (ii) and (v). For example the following 
choices of £ and m satisfy (i)-(v): let i{t) and m{t) be arbitrarily defined for t £ [0,e], and 

£(i) :=ti-i/^'°siogt)^ m(t) :=ti-^/(2i°gi°g*) for t > to > e. 

For concreteness, let us fix these choices and note that p is monotone increasing for large t. 

6.2.3. Part III: Completing the refined lower estimate 
Fix 5 e (0, /32) and define 

I{t):=YeMm))\- 
Let At denote the following event: 

At:={\Z,^t)\>I{t)}. 
By (16) we know that on a set of full P-measure, 

lim P'^(.4t) = 1. (27) 

By (27), for t fixed we can work on At <Z Q and consider I{t) many particles at time l{t). 

As a next step, we need some control on their spatial position. To achieve this, use Remark 1 to compare 
BBM's with and without obstacles, and then, use the following result taken from Proposition 2.3 in [12] (the 
stronger, a.s. result is proved in [29]). 

Denote Z the BBM without obstacles (and hence with rate 132) starting at the origin with a single particle. 
Let R{t) = Usg[o t] supp(2(s)) denote the range of Z up to time t. Let 

M(t)=inf{r>0; i?(t)CB(0,r)} ford>l, (28) 

be the radius of the minimal ball containing R{t). Then M{t)/t converges to in probability as t — *■ oo. 

Going back to the set of lit) many particles at time lit), (28) yields that even though they are at different 
locations, still for any e' > 0, with P'^ -probability tending to one, they are all inside the (V2/32 -t-£')^(t)-ball. 
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Define 

p{t) = p{l{t)) := R^llogmf" ~ [loglog£(0]' for t>h> e^ 

Recall (26). With P-probabiHty one there is a clearing B = B{xo,p{t)) such that |a;o| < i{t), for all large 
enough t>0. In the sequel we will assume the 'worst case,' when |xo| = i{t). Indeed, it is easy to see that 
\xo\ < £{t) would help in all the arguments below. (Of course, xq depends on t, but this dependence is 
suppressed in our notation.) By the previous paragraph, with P'^ -probability tending to one, the distance 
of xq from each of the I{t) many particles is at most 

{l + ^/2^ + e')£{t). 

Now, any such particle moves to B{xo, 1) in another ■m{t) — £{t) time with probability qt, where (using (iii) 
and (iv) along with the Gaussian density) 

2[m(t)-£(i)] V 2[m{t)-£{t)] J J 

Let the particle positions at time £{t) be zi, Z2, . . . , 2/(t) and consider the independent system of Brownian 
particles 

{IF,.; i = l,2,...,/(i)}, 

where Wz^ (0) = Zi] i = 1, 2, . . .,I{t). In other words, {Wz^; i = 1,2, . . . ,/(t)} just describes the evolution of 
the I{t) particles picked at time £{t) without respect to their possible further descendants and (using the 
Markov property) by resetting the clock at time £{t). 
Let Ct denote the following event: 

Ct:={3je{l,2,...,/(t)}, 30 <s<m{t)~£(t) such that W^^is) € B{xo,l)}. 

By the independence of the particles, 

limsupP"(Q|ylt) ==limsup(l-gt)'^(*) =limsup[(l-9t)i/«*]''-^^*\ (29) 

>oo t— ^OO t — !-00 

Since (iii) implies that ~ o{£{t)) as i — ^ oo and since (i) is assumed, one has 

In view of this, (29) implies that limt^oo P'^{Cf\At) — 0. Using this along with (27), it follows that on a set 
of full P-measure, 

lim P'^(Ct) = l. (30) 

t — ^oo 

Once we know (30), we proceed as follows. Recall that B = B{xo,p{t)) and that {P^,; x G M''} denote the 
probabilities corresponding to a single generic Brownian particle W (being different from the Wz^ above). 
Let a^' denote the first exit time from B: 

'^B-<^B%„Am ■■-inf{s>0\W,iB}. 
Abbreviate t* -.— t ~ m{t) and define 

Pt-= sup P,(t7^«>r)= sup P,(aB>r), (31) 

x£B{xo,l) xe-B(0,l) 



Branching Brownian motion in a random medium 



507 



where <tb '■= <^'b- Recall that the radius of B is 
p{t) = Ro[\og 



- Oilloglii)]"") = V0gl{t)f' 0([l0g^(t)]^/'^) 



and recall the definition of from Claim 3. Then, as t — > oo, 



Pt = exp 



\d-t* 



-■ exp 



''^ [l0g€(t)]2/rf + ° [logf (t)]2/d ) 



Using (ii) and (v), it follows that in fact 



Pt = exp 



—c{d, v) 



(log^Vd \{\0gtY/d 



A little later we will also need the following notation: 



sup P,K»>.s) 

xeB(xaS) 

with this notation, 



sup P.-r(crB > s), 

i:eS(0,l) 



(32) 



(33) 



(34) 



Pt ^Pf 

By slightly changing the notation, let denote the BBM starting with a single particle a.t x E B; and 
let Z^'^ denote the BBM starting with a single particle at x e _B and with absorbtion at dB (and still 
branching at the boundary at rate ^2)- 

Since branching does not depend on motion, \Z^-^\ is a non-spatial Yule's process (and of course it does 
not depend on x) and thus for all x G B, 



3N:^ lim e~**|Zf-^| >0 



(35) 



almost surely (see Theorems III. 7. 1-2 in [1]). 

Note that some particles of Z^ may re-enter B after exiting, whereas for Z^'^ that may not happen. 
Thus, by a simple coupling argument, one has that for all t>0, the random variable \Zf{B)\ is stochastically 
larger than |Zf'-^(B)|. 

Recall that our goal is to show (24), and recall also (31) and (33). In fact, we will prove the following, 
somewhat stronger version of (24): we will show that if the function 7 : [0, 00) [0, 00) satisfies limt^oo 7t = 0, 
then on a set of full P-measure, 



lim p-(|Zt| <7fe'^^**pt) = 0. 

t — >oo 



Recalling t* —t — m{t), and setting 

t 



(36) 



"ft ■= exp mit) — e 



(logi)2/rf 



for t > <o > e, 



a simple computation shows that (36) yields (24). Note that this particular 7 satisfies limt^oo 7t = because 
of the condition (v) on the function m. 

By the comparison between \Zf{B)\ and {B)\ (discussed in the paragraph after (35)) along with 

(30) and the Markov property applied at time m(t), we have that 



lim P{\Zt\ < "It ■ e^'*'pt) < lim sup P(|Zf;^(B)| < -ft ■ 0^'^'" pt). 
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Consider now the J{x, t) := \Z^t^\ many Brownian paths starting at x G B, which are correlated through 
common ancestry, and let us denote them by Wi, . . . , Wji^^ ty Let 

J(x,t) 
i=l 

where 



A,:={W,{s)c,B, VO<s<t}. 
Then we have to show that 



L := Um sup P{n^ < 7t • e' 
Clearly, for all x E B, 



At* 



Pt) 



(37) 



L — lim sup P 



'xeB 



< 



ItPt 



< lim sup 



1 



Using the fact that linit^+oo 7t = and that N is almost surely positive, 
lim P(A^<27i)=0; 

t^OO 

hence it is enough to show that 



(38) 



lim sup P 



nf 1 , 



(39) 



The strategy for the rest of the proof is conditioning on the value of the positive random variable N and 
then using Chebysev's inequality, for which we will have to carry out some variance calculations. Since the 
particles are correlated through common ancestry, we will have to handle the distribution of the splitting 
time of the most common ancestor of two generic particles. Doing so, we will prove a lemma, while some 
further computations will be deferred to Appendix B. 

Let R denote the law of N and define the conditional laws 



py{-):^P{-\N^y), y>0. 



Then 



1 



Define the conditional probabilities 



f nf 



py{-) Py{-\\Z^J > lit) - P{-\N = 2/, \zfj > mO, y > 0, 

where fit = ■= [■^e'^^* J . Recall that (31) defines pt by taking supremum over x and that \Z^'^\ in fact 
does not depend on x. One has 



P 



Ridy) 



py 



( nf 1 



Pt 



py e 



-I32t* I yX.B\ 



(40) 
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As far as the second term of the integrand in (40) is concerned, the Umit in (35) impUes that 



Urn / R{dy) py I e^-^^*' |Zf -^1 < 72/ ) = hm P[ e 



<-N\=Q 



Let us now concentrate on the first term of the integrand in (40). In fact, it is enough to prove that for 
each fixed K >Q, 



hm / R{Ay)py\ 



Indeed, once we know (41), we can write 
hm / R{dy)py(^<-pt 



(41) 



< hm / R{dy)py 

l/K 



yo 



°4 



= R 



«4 



(42) 



Since this is true for aU X > 0, thus letting K 00., 



lim / R{dy)py 



( 1, 



Pt = 0. 



\y& 

Returning to (41), let us pick randomly /it many points out of the J{x,t) many particles - this is almost 
surely possible under P^ . (Again, 'randomly' means that the way we pick the particles is independent of 
their genealogy and their spatial position.) Let us denote the collection of these /it many particles by Aff. 
Define 



Then, one has 



py 



yc 



At' < 



(43) 



We are going to use Chebyshev's inequality and therefore we now calculate the variance. Recall that pt = 
suPj;gB(o.i) ^xicTB >t*)- Using that for x e B{0, 1), 

Px{<JB >t)- [P,(as >t)f <r,{<JB>t)< P.(tTs >t*)<pt, 

one has 

Var (n^)<f^tpt + fj,t{pt-l)^-Jl '—J , 

MfJ-t - 1) 

where K{t,x) := {(«, j): * 7^ j, 1 < hj < A't}. Now observe that 

S,,.x(..)C^-(U.U.) ^ E55V^(U., = (E « P^)(A. n A,)^pl 
tJ-tylJ-t — -Lj 

where under P the pair is chosen randomly and uniformly over the fJ-tifJ-t — 1) many possible pairs. 
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Let Q*'^ and Q'*) denote the distribution of thc^ splitting time of the most recent common ancestor of 
the ith and the jth particle under and under P, respectively. By the Markov property applied at this 
splitting time s, one has 

Js=0 J B 

where 

p<*)(0,i,d2;) ■.^¥o{Wt<EAx\W^<=,B, z<t). 
By the Markov property applied at time s, 

p\ / p^_,,^p^*^(0,s,dx)=pt, 

JB 

and thus 

{Er^py){AnA,)^Pt f ^0*'nds). 

J s=0 Ps 

Hence 

Var'(Hn < -P?) + Mt^t - l)p't ■ (It - 1), (44) 
where 

/ [pT'Q'^yids). 

Note that this estimate is uniform in x (see the definition of pt in (31)). Define also 

/•OC 

Jt-= [pT'Q^'Hds). 

Js=0 



Lemma 11. 



lim Jt ~ I. 

t — ^oo 



(45) 



The proof of this lemma is deferred to the end of this section. 

Once we know (45), we proceed as follows. Using Chebyshev's inequality, one has 



py 



1 



ye'" 



1 



-<^Pt]<P^ K - Eyn^l > ^Ptye^''' ) < 16- 



Var (nf) 



Piy 



2g2/32t* 



By (44), we can continue the estimate by 



< 16 



^J■tpt 



+ -^fJ-tifJ-t - I) ■ y e 



-2^-2/32** 



Writing out fj,t, integrating against R{dy), and using that the lower limit in the integral is 1/K, one obtains 
the upper estimate 



l/K 



Ridy)py 



1 



ye 



< UKpT'e-f"^' + / R{dy) -^f^t - 1) • y-^e^^ftt . (j^ _ 

Jl/K ^ 



(46) 
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(Recall that It in fact depends on y.) Since limt^ooptc^^* = oo, thus the first term on the right-hand side of 

(46) tends to zero as t — > oo. Recall now that yUt := [ — J . As far as the second term of (46) is concerned, 
it is easy to see that it also tends to zero as t — > oo, provided 

POO 

lim / i?(dy)(/t-l) = 0. 

But R{dy)ilt - 1) = Jt - 1 and so we are finished by recalling (45). Hence (41) follows. This completes 
the proof of the lower estimate in Theorem 1. 

6.2.4- Proof of Lemma 11 

Since Jt > 1, thus it is enough to prove that 

lim sup Jf < 1 • 

t — *oo 

For r > we denote by A* := Ac(|Z\, i?(0, r)) the principal eigenvalue of iz\ on i?(0,r). Since A* tends to 
zero as r t oo we can pick an i? > such that —X*n< (32. Let us fix this R for the rest of the proof. 

Let us also fix t > for a moment. From the probabilistic representation of the principal eigenvalue (see 
Chapter 4 in [32]) we conclude the following: for e > fixed there exists a T(e) such that for s > T{e), 

logp* > (Ap(t) - i)s. 

Hence, for e > small enough (e < — A|j) and for all t satisfying Ap(t) > A^ + e (recall that limt^oo p{t) = oo) 
ands>r(£,i), 

logp* > X*j, ■ s. (47) 

Note that T{i,t) can be chosen uniformly in t because^ limf„>oo pit) = oo, and so we will simply write T(e). 
Furthermore, clearly, T(s) can be chosen in such a way that 

limT(e) = oo. (48) 

HQ 

Depending on s let us break the integral into two parts: 



Js=0 Js=T(i) 



T{i) 

We are going to control the two terms separately. 
Controlling J^^'^ : We show that 

There exists the limit lim J^^^^ < 1. (49) 

t — >oo 

First, it is easy to check that for all t > 0, Q'^^^ds) is absolutely continuous, i.e. Q^^\ds) — g^*\s)ds with 
some (?*^*^ > 0. So 

Js=0 Js=0 

Evidently, one has [p*]^^ | as < — > oo. Also, since Q^*)([a,6]) is monotone non-increasing in t for < a < b, 
therefore 5^*''(-) is also monotone non-increasing in t. Hence, by monotone convergence. 



limJt^^^=/ 5(s)ds= lim / g(*)(s) ds < lim / 5(*)(s)ds = l, 



^Recall that we picked a version of p{t) which is monotone increasing for large Vs. 
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where g := linif_,oo g^*^ . 
Controlling Jj : Recall that 

logp*>A|j-s, Vs>T(£). (50) 

Thus, 



jf' < /* exp(-AJj-s)Q(*)(ds). 



/T(e) 

We will show that 



limlim/' exp(-Ao-s)Q(*Vd.s)=lim lim / e-(^«+*)'* e*^Q(*Vds) = 0. (51) 

Recall that < /32 + A]ij. In order to verify (51), we will show that given to > there exists some Q < K = K{tQ) 
with the property that 

g^^\s)<Ksc-^^', for t >io,sG [io,i]- (52) 
Indeed, it will then follow that 



limlim / exp(-A|j-s)Q(*)(ds)= lim lim / exp(-A|j • s) g(*)(s)(ds) 

poo 

< if lim / sc"(^«+'^^)"(ds) =0. 



Recall that Q*^*) corresponds to the conditional law P(-||Zj^^| > ^t). We now claim that we can work with 
P{-\\Z^J > 2) instead of P{-\\Z^J > ^jn)- This is because if corresponds to P{-\\Z^J > 2), then an easy 
computation reveals that for any e > there exists a io = io{£) such that for all t>io and for all < a < 6, 

|Q«([a,6]) - Q^^\[a,b])\ < 2{1 + e)Qi'\[a,b]); 
thus, if 

Q[)*^(ds) < Lse-^^" ds on [to, i] for t > to (53) 

holds with some L > 0, then also 

Q(*)(ds)=5(*)(s)ds<is:se-*Ms, t > to V to, s G [io,t] (54) 

holds with K -.= 1 + 2(1 + e). 

The bound (53) is verified in Appendix B. 

It is now easy to finish the proof of (45). To make the dependence on e clear, let us write Jj'-* = J^*'' (e), i = 
1,2. Then by (49), one has that for all e > 0, 

(2) 

lim sup < 1 + lim sup (s) . 

t— J'OO t — >oo 

Hence, (51) yields 

(2) 

lim sup Jt < 1 + lim lim sup Jj (e) < 1, 

t->cx3 eiO t-»oo 

finishing the proof of the lemma. □ 
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7. Some additional problems 

These problems were deferred to the section after the proofs, because the questions themselves refer to parts 
of the proofs. 

Problem 12. The end of the proof for the lower estimate in Theorem 1 is basically a version of the Weak 
Law of Large Numbers. Using SLLN instead (and making some appropriate changes elsewhere), can one get 

liminf(logi)^/''(rt - /^a) > -c(d, 77) a.s.? 

t — *oc 

Problem 13. The question investigated in this paper was the (local and global) growth rate of the popula- 
tion. The next step can be the following: Once one knows the global population size \Zt\, the model can be 
rescaled (normalized) by \Zt\, giving a population of fixed weight. In other words, one considers the discrete 
probability measure valued process 

Then the question of the shape of the population for Z for large times is given by the limiting behavior of 
the random probability measures Zt, t>0. (Of course, not only the particle mass has to be scaled, but also 
the spatial scales are interesting - see last paragraph.) 

Can one for example locate a unique dominant branch for almost every environment, so that the total 
weight of its complement tends to (as i — > 00) zero? 

The motivation for this question comes from our proof of the lower estimate for Theorem 1. It seems 
conceivable that for large times the 'bulk' of the population will live in a clearing within distance £{t) and 
with radius 

p{t) i?o[log€(t)]'/' - [loglog^(t)]', t > 0, 

where 

lim £(t) = 00 and lim = but lim - — = 1. 

t^oo t^co t t^oo \ogl[t) 



8. Proof of Theorem 2 



8.1. Preparation for the proof 

We first state an abstract lemma as follows. 



Lemma 14. Given the probability triple {fl^ J- ^P) , let Ai, ... ^ A^^ ^ J- be events that are positively corre- 
latedin the following sense. Ifk<N and {ji, ja, ■ • ■ , jfc} ^ {1, 2, . . . , iV} then coY{lAj^nA,.^nA,^-nAj^_^ , 1a, J 
0. Then 

CN \ N 
{^aA>\{p{a,). 
i=l / i=l 

Proof. We use induction on N. Let N = 2. Then ^(AinAa) > P{Ai)P{A2) is tantamoimt to cov(1ai, IA2) > 
0. 

If + 1 events are positively correlated in the above sense then any subset of them is positively correlated 
as well. Given that the statement is true for N >2, one has 



/N+1 \ / ^ \ ^ ^+1 

P( n AA>pif]AAp{AN+,)>P{AN+,)l[p{A,)=Y[p{A,), 
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and so the statement is true for iV + 1 . □ 

Corollary 15. Consider Z, the [L, (3) -branching diffusion where L is a second order differential operator 
corresponding to the diffusion process Y on with probabilities {Qx, x G Mf^}, and the branching rate 
(3 ~ f3{-) > is not identically zero. For t > let denote the number of particles at t and let Bt be an 
open set containing the origin. 

Let the function g : M-j- N+ be so large that linit^oo P{\Zt\ < g{t)) — 1- Then the lower estimate 

Po[supp(Z,) e Bt, < s < t] > [Qo(n eBt, < s < t)]^**^ - o(l) 

holds. 

Proof. Let us label the particles in a way that does not depend on their motion. We get Nt (correlated) 
trajectories of Y: Y^"^ , l<i<Nt. Denote A, := (ri*' e Bt, < s < t). When Nt < g{t), consider some 
additional (positively correlated) 'imaginary' particles - for example by taking g{t) — Nt extra copies of the 
first particle. We have 



/Nt \ /g{t) \ 

Fo[supp(Z,)ePt, 0<s<t] =Po( >pA[]A,r\{Nt<g{t)]\ 

/9(t) \ 

>Po( Ha 1 -P^{Nt>g{t)). 



It is easy to check that Ai, A2, . . . , Ag(^t) are positively correlated, hence one can continue the lower estimate 
with 

9it) 

> Yl PiA,) - 0(1) = [Qo(n eBt,0<s< t)f'^ - 0(1). 
1=1 

The proof is finished. □ 
8.2. Proof of the theorem 



First, the equation (8) follows from the Taylor expansion \/l — x = 1 — |- + ©(x^), x~0. 

For (9), recall that /(t) c{d, v) 0Qg^-)2/d a-nd the result on the quenched global population: there are 
roughly exp[/32t — f{t)] particles by time t. More precisely, on a set of full P-measure, 

lim {\ogtf/'^{rt - P2) = -c{d, v) in P'^-probabihty. (55) 

t — ^00 

In particular, for all e > 0, as i — > 00, 

P^{\Zt\ > e^^*--^'W+^) = o(logt-2/'*). (56) 
The rest is a straightforward computation. We apply Corollary 15 with 

Denote Ct := {\Zt\ < g{t)}. Using that limt_oo -P'^(Ct) = 1 and that 

n^t) = 2t'[f32 - c(d,z.)(logt)-2/^] (57) 
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along with Corollary 15, it follows that for P-almost all lo, 

cxp[/32t-/(t)+£] 



P^iAt)> 1 -exp 



0(1) 



2t 

= (1 - exp[-/?2i + /(t)])^'^P[^=*-^(*)+^l - 0(1) e-''' , as t ^ oo. 
Consequently, for P-almost all ui, liminft^oo P"(At) > 0. 

Appendix A. Related population models 

In this section we explain how our mathematical setting relates to models in biology. 
First, one immediately has the following two biological interpretations in mind: 

(i) Migration with unfertile areas (Population dynamics): Population moves in space and reproduces by 
binary splitting, but randomly located reproduction-suppressing areas modify the growth. 

(ii) Fecundity selection (Genetics): Reproduction and mutation takes place. Certain randomly distributed 
genetic types have low fitness: even though they can be obtained by mutation, they themselves do not 
reproduce easily, unless mutation transforms them to different genetic types. In genetics this phenomenon 
is called ^fecundity selection.^ Of course, in this setting 'space' means the space of genetic types rather 
than physical space. 

One question of interest is of course the (local and global) growth rate of the population. Once one knows 
the global population size, the model can be rescaled (normalized) by the global population size, giving a 
population of unit mass (somewhat similarly to the fixed size assumption in the Moran model or many other 
models from theoretical biology) and then the question becomes the shape of the population. 

In the population dynamics setting this latter question concerns whether or not there is a preferred spatial 
location for the process to populate. In the genetic setting the question is about the existence of a certain 
kind of genetic type that is preferred in the long run that lowers the risk of low fecundity caused by mutating 
into less fit genetics types. 

Of course, the genealogical structure is a very exciting problem to explore too. For example it seems quite 
possible that for large times the 'bulk' of the population consists of descendants of a single particle that 
decided to travel far enough (resp. to mutate many times) in order to be in a less hostile environment (resp. 
in high fitness genetic type area), where she and her descendants can reproduce freely. 

For example, a related phenomenon in marine systems [6] is when hypoxic patches form in estuaries 
because of stratification of the water. The patches affect different organisms in different ways but are 
detrimental to some of them. They appear and disappear in an effectively stochastic way. This is an actual 
system that has some features that correspond to the type of assumptions built into our model. 

It appears [22] that a very relevant existing ecological context in which to place our model is the so-called 
\source-sink theory.^ The basic idea is that some patches of habitat are good for a species (and growth rate 
is positive) whereas other patches are poor (and growth rate is smaller, or is zero or negative). Individuals 
can move between patches randomly or according to more detailed biological rules for behavior. 

Another kind of scenario where models such as the proposed one would make sense is in systems that are 
subject to periodic local disturbances [6]. Those would include forests where trees sometimes fall creating 
gaps (which have various effects on different species but may harm some) or areas of grass or brush which 
are subject to occasional fires. Again, the effects may be mixed, but the burned areas can be expected to be 
less suitable habitats for at least some organisms. 

Finally we refer the reader to the excellent monograph [7] for a modern introduction to population models 
(from the PDE point of view). 
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Appendix B. Proof of the bound (53) 

In this section we give the proof of the bound (53). In fact we prove a precise formula for the distribution 
of the sphtting time of the most recent common ancestor, which, we beheve, is of independent interest. The 
result and its proof arc due to W. Angercr and A. Wakolbingcr (personal communication). 

For simplicity we set /32 = 1; the general case is similar. Let us fix t > 0. Then for <u<t, one has 



(,) _ 1 - 2,.c-" - e-^" + e-\2u - 3 + 4e-" - c'^") 

^0 (ssu)- (i_e-t)(i-£.-"^2 ' y^^) 



and so the density is 

mt ^ -d^o. , _ ^ c-^ju ~2 + iu + 2)c-") + c-«(l - 2uc-^ - c'^") 
; [u):- [u)-Z (l-c-*)(l-c-)3 

where / denotes Lebesgue measure on [0,t]. 

Proof of (58). Consider the Yule population Yt := \Z^^\ and recall that Qq^ corresponds to Pi-\Yt > 2). 
The first observation concerns the Yule genealogy. Let us pick a pair of individuals from the Yule population 
at time t, assuming that Yt = j, j > 2. Denote by / the size of the population just before the coalescence 
time s of the two ancestral lines (where 'before' refers to backward time). That is, let / := Yg+dt- Using some 
formulae from [20], we now show that 

P(/ = ,) = l±i._A^.i^. (59) 

^ ' j-l {i-l)i i+l ^ ^ 

Indeed, the distribution of / equals the conditional distribution of F given F<j, where F is defined as 
follows. First, the pure birth process K ~ [Ki) (with respect to 'Yule-time' i) is defined in Section 3.5 of 
[20], and setting n~2, 

P{K,^i = l\K, = 2)= ^ 



(see formula (4.10) of the paper). Then the 'hitting time' F is defined (in the same section) by F := 
min{Z : Ki = 2}. The formula for the distribution of F (formula (2.3) of the paper) now becomes 

P{F<i)=P{Iu = 2)^'—^, i>2. 

Let i<j. Then 

P{I = i) = P{F = i\F < j) = P{K,^i = 1, = 21^^ < j) 

= P(AVi = l,A', = 2|if,=2) 

_ P(A,_i = l,A, = 2) 
P(A, = 2) 

From the last three displayed formulae one arrives immediately at (59). 

Let us now embed the 'Yule time' into real time. Since a Yule population stemming from i ancestors 
has a negative binomial distribution, therefore, using the Markov property at times u and u + du, one can 
decompose 



P{Yu = i - 1, Yu+ du = i,Yt= j) =pi-p2-P3, 



(60) 



Branching Brownian motion in a random medium 



517 



where 



Pl=e-"(l-e-")'-^ 
P2 ^ {i — l)du and 

P3 



That is, 

P{Yu = i-l,Yu+du = i,Yt^j) 



{t - 1) (^^ _ J ^ e-(*-")*(l - e-(*-"))^-*e-"(l - e"")^"' dw. 



Since the pair wc have chosen coalesce independently from the rest of the population, the random variables 
s and / are independent. Using the definition of s first and then the independence remarked in the previous 
sentence, and finally (59) and (60), 

P{s e[u,u + du],Ys+dt ^i,Yt= j) = P{I = i,Yu^i- 1, K^+du = i,Yt= j) 

= Pil = ^)P(K„ = z - 1, y„+d„ = ^, = j) 



\i-2) + " J c u e J 



du, 



for < u < t. 

Now, summing from j ~ i to oo, and from i ~ 2 to oo, and then dividing by P{Yt > 2) = 1 — c^', one 
obtains (after doing some algebra) that for < u < t, 

^(t)^ , J ^^ ^ _„2(2e-(*-")+i-l)(l-e-")^-2 
Qn(.G(.,.+ d.)).ge (i_e^^)^(/+l) 

e-"(ii - 2 + (u + 2)e-") + e-*(l - 2Me-" - e^^") 

= 2 ■ 7- 777 du. 

(l-e-')(l-e-")3 

Equivalently, in integrated form, one has (58). □ 
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